"The highlighted tokens are primarily Korean morphemes, words, or short phrases that serve as key semantic units in sentences, often marking grammatical roles, objects, actions, or important nouns. Many activations correspond to noun or verb stems, particles, or endings that are essential for meaning in Korean syntax. Some tokens are also numbers, time expressions, or units, which are important for conveying quantitative or temporal information. Additionally, there are frequent occurrences of corrupted or garbled characters, likely due to encoding issues, which are also marked as important, possibly because they disrupt or alter the expected language pattern."
Score Type | Accuracy | Precision | Recall | F1 score | TPR | TNR | FPR | FNR |
---|---|---|---|---|---|---|---|---|
detection | 0.81 | 1.0 | 0.62 | 0.765 | 0.62 | 1.0 | 0.0 | 0.38 |
fuzz | 0.79 | 0.914 | 0.64 | 0.753 | 0.64 | 0.94 | 0.06 | 0.36 |